Skip to content

test(training-agent): derive validator-gate seed passes from fixtures - #7976

Merged
bokelley merged 1 commit into
mainfrom
w-552/fix-tool-catalog-drift-seed-count
Oct 6, 2026
Merged

bokelley merged 1 commit into
mainfrom
w-552/fix-tool-catalog-drift-seed-count

Conversation

@bokelley

@bokelley bokelley commented Oct 6, 2026 •

Copy link
Copy Markdown
Contributor

Summary

main has failed Server integration tests (3/4), a required check, since #7541 (9d726b51, then cc2d5b8d):

tool-catalog drift detection > /brand loses only controller setup passes from the two corrected validator gates
AssertionError: expected 15 to be 14

The test hard-coded the passes the old validate_input OR comply_test_controller gate earned: 14 for ctv-experience-validate-input and 18 for premium-display-canonical-validation, all of them seed_product.* steps. Each storyboard also has one fixtures.accounts entry, and the @adcp/sdk 14.2 runner (#7931) seeds it as a passing seed_account.* controller step. That makes 15 and 19 passes.

The test now:

  • derives the expected count as fixture products plus fixture accounts, so adding a fixture doesn't break it again;
  • accepts seed_account.* alongside seed_product.* as controller setup passes.

The rest of the assertion is unchanged: every pass is still a controller seed, and every validator step is still skipped as missing_tool.

Validation

  • npx vitest run server/tests/integration/training-agent-tool-catalog-drift.test.ts: 11/11 pass. The same command on unmodified main gives 2 failures (expected 15 to be 14).
  • npm run typecheck passes.

This also unblocks #7953 and every other PR into main.

🤖 Generated with Claude Code


Open workspace in Conductor

The drift test from #7541 hard-coded 14 and 18 seed_product passes. The
@adcp/sdk 14.2 runner also seeds each fixture account through the
controller, so /brand and /governance now earn 15 and 19 passes, and main
fails Server integration tests (3/4). Count fixture products plus fixture
accounts and accept seed_account steps alongside seed_product.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

@aao-secretariat aao-secretariat Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ladon verdict: Approve

Approve — single test-only fix with no blocking or medium findings.

This PR touches one file: server/tests/integration/training-agent-tool-catalog-drift.test.ts (+7/-5). It derives the expected validator-gate seed count from fixtures (products + accounts) instead of re-hardcoding, and widens the pass check to accept seed_account.* alongside seed_product.* to match the @adcp/sdk 14.2 runner that now seeds fixture accounts as controller passes. The toBeGreaterThan(0) guard prevents a vacuous assertion.

Checks:

  • No published-surface change (no static/schemas/source/**, docs/reference/**, dist/**, or task/compliance assets) — no changeset required.
  • high_risk: false; gated_paths: false.
  • No no-auto-approve team match.
  • Reviewer surfaced zero findings.

Decision table: rows 1–8 do not fire (no critical/high/medium findings, no gated paths, no high-risk deletion/modification, no team gate). Note review_decision is REVIEW_REQUIRED, but with gated_paths false that does not block (deprecated protected-branch rule removed). Falls through to row 9 → approve.

@bokelley
bokelley merged commit d43a516 into main Oct 6, 2026
30 checks passed
@bokelley
bokelley deleted the w-552/fix-tool-catalog-drift-seed-count branch October 6, 2026 23:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant